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ON  A  LINEAR  PPOORAMKING-COMBINATORIAL 
APPROACH  TO  THE  TRAVELING  SALESMAN  PROBLEM 

0.  P.  Dantzlg 
D.  R.  Fulkerson 
S.  M.  Johnson 


1,  Introduction 

In  our  paper  published  in  JOP-SA  In  November,  195^,  entitled 
"Solution  of  a  Large  Scale  Traveling  Salesman  Problem,"  2^],  we 
chose  the  well  known  example  of  finding  the  Lest  way  to  tour  a 
set  of  cities,  one  selected  from  each  of  the  48  states,  In  order 
to  Indicate  the  power  of  a  linear  programming  approach  to  the 
traveling  salesman  problem.  A  way  of  using  linear  programirlnr’ 
in  conjunction  with  combinatorial  methods  was  also  mentioned 
briefly  In  ^l]  .  However,  Judging  from  the  number  of  queries  v/e 
have  received  from  readers  of  our  previous  paper,  this  met*^  od 
was  not  elaborated  sufficiently  to  make  the  proposal  clear. 

Since  It  Is  our  belief  that  a  linear  programming— comb  Inatorla 
approach  affords  a  practical  way  of  solving  travel Ing—ealesran 
problems,  we  shall  attempt.  In  this  note,  to  explain  this 
approach  In  more  detail. 

To  Illustrate  the  method  we  have  chosen  the  example  dis¬ 
cussed  by  L.  L.  Btrachet  In  the  December  1987  Issue  of  JC^SA. 
In  that  note  he  describes  a  procedure  of  successively  Improving 
a  solution  by  using  certain  necessary  conditions  for  optimality. 
Ha  points  out  that  there  Is  no  guarantee  that  tie  final  to\it 
obtained  by  his  approach  Is  optimal.  In  contrast,  we  shall 
Start  iflth  his  Initial  tour.  Improve  It,  and  give  a  proof  t!.at 

i 

his  final  solution  Is  Indeed  optimal. 
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2,  Barachet»s  Example  and  Its  Solution 

Ve  shall  assume  that  the  reader  Is  familiar  with  our 
earlier  paper  [i]  .  See  also  [^J  for  a  general  discussion.  The 
linear  programming  approach  suggested  in  DQ  is  to  start  with  a 
tour  and  a  small  number  of  linear  eqxiality  and  inequality  con¬ 
straints  that  are  satisfied  by  all  tours,  then  use  the  simplex 
method  to  move  to  a  new  basic  solution.  If  the  new  solution  is 
not  a  tour,  impose  an  additional  constraint  on  the  problem  that 
cuts  out  this  solution  but  no  tours,  and  again,  in  the  new 
convex  set  thus  defined,  move  to  an  adjacent  solution.  At  a 
suitable  stage  in  the  process,  it  is  usually  advantageous  to 
use  the  estimation  procedure  described  in  [l]  in  conjunction 
with  a  combinatorial  analysis  of  undominated  tours. 

In  Darachet's  ten-city  example,  we  shall  find  that  in 
addition  to  the  starting  conditions  on  the  nonnegative  variables 
1  ^  j )  # 

,1,...,9)» 

only  upper  bounds  on  certain  variables  will  take  us  to  a  stage 
where  the  estimation  procedure  emd  combinatorial  analysis  suffice 
to  solve  the  problem.  Thus  we  will  not  need  the  additional  loop 
constraints  described  in  [ij  ,  or  any  constraints  of  a  more 
complicated  nature.  Indeed,  our  experience  indicates  that  (l) 
and 

(2)  <  1, 

in  conjunction  with  combinatorial  arguments,  often  suffice  for  small 


problems 
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For  example,  T.  Robacker,  while  at  RAND,  waa  able  to  solve  a 
series  of  ten  9-clty  problems,  each  having  a  "random  distance" 
matrix,  by  the  use  of  (1)  and  (2)  only.  More  recently  an  experiment 
was  run  by  Leola  Cutler  on  the  RAND  electronic  computer  JOHNNIAC* 

One  hundred  10-clty  problems,  each  having  a  "reuidom  dlata^ice"  matrix, 
were  solved  assuming  again  only  conditions  (1)  etnd  (2).  In  56  ^  of 
the  cases  the  optimal  solution  was  a  tour*. 

Distances  between  the  ten  cities  0,1,..., 9  for  Barachet's 
problem  are  given  In  Table  1.  Figure  1  la  his  map  of  the  cltlea 
relative  to  each  other,  the  heavy  line  being  hla  starting  tour.  To 
get  a  starting  set  of  conditions  with  respect  to  which  this  tour  Is 
a  basic  solution,  we  Impose,  In  addition  to  (1),  an  upper  bound  on 
Xj2»  basic  variable  x^0  (with  value  0)  .  The  presence 

of  an  upper  bound  on  x^2  depicted  In  Figure  1  by  a  bar  on  link 
12.  Alternatively,  we  may  think  of  all  upper  bound  relations  (2) 
as  being  present  In  the  problem,  and  view  as  a  "non— basic 

variable"  at  Its  upper  bound  value  of  unity  (Instead  of  zero). 


Since  we  shall  use  only  upper  bounds  to  solve  this  problem,  the 
latter  point  of  view  will  simplify  our  description  of  the  solution 
process,  and  we  therefore  adopt  It. 

The  first  step  Is  to  compute  "potentials"  (simplex  multi¬ 
pliers  or  prices)  satisfying 


(»  *1  +  -  “ij 

eorrsspondlng  to  basic  variables  .  These  are  shown  adjacent 
,to  the  cities  In  Figure  1 .  Next  compute 

jT; 

;  V,  >►  V.  —  d.  .  (for  zero  non— basic  variables) 

(A)  ^11-1  ^  ^ 

-f  Vj  —  dj^j)  (for  positive  non— basic  variables). 

*0f  the  100  cases,  56  were  tours,  40  were  loops,  4  were  fractional. 
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If  <  0  for  all  non-baslc  variables,  the  tour  Is  established 

as  optimal.  Otherwise,  we  select  some  non-baslc  variable  corres¬ 
ponding  to  >  0  for  entry  Into  the  basic  set.  T^lroughout 
this  problem  we  shall  use  the  standard  criterion  used  In  the 
simplex  method  for  this  selection,  l.e.  we  take  the  largest 
and  attempt  to  Increase  the  corresponding  non-baslc  variable 

If  It  has  value  zero,  or  decrease  It  if  its  value  Is  unity, 
thereby  obtaining  a  new  basic  set  of  variables. 

Using  the  values  of  ir^  as  shown  In  Figure  1,  we  find  that 
«  33  Is  maximal  and  thus  Introduce  x^^  Into  the  basic  set 
(this  Is  symbolized  in  Figure  1  by  the  arrowheads  on  link  1,7). 
Adjustments  in  the  values  of  basic  variables  corresponding  to 
’'17  “  ^  ^  °  are  shown  In  brackets  next  to  the  appropriate  links 
In  Figure  1 .  Since  Xq^  ■  1  ♦  ^  >  1 ,  we  determine  that  ^  •  0 
and  drop  Xq^  from  the  basic  set. 

This  brings  the  computation  to  Figure  2,  where  new  potentials 
are  computed  as  shown  there,  and  Xq^,  with  6^^  ■  33,  Is  to  be 
Introduced.  This  time  the  value  of  Xq^  can  be  Increased  to 
«  1  without  violating  any  of  the  conditions  (l)  and  (2),  at 
which  point  we  obtain  a  new  tour  (l,2,3»^»5»0,9,8,6,7) ,  which 
Is  therefore  33  units  shorter  than  the  original  one.  This 
leads  to  Figure  3*  where  the  solid  lines  now  correspond  to  the 
new  tour,  and  link  0,1  has  been  dropped  from  the  figure,  l.e. 

Xq^  has  become  a  zero  non-baslc  variable  (alternatively,  we 
could  have  dropped  x^^  or  The  variable  x^^  Is  then 

selected  to  enter  the  basic  set,  and  X|^^  becomes  a  non-baslc 
variable  having  value  1. 
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Two  more  Iterations  produce  Figures  4  and  5.  At  this  stage 
of  the  computation  (Figure  5)  we  note  after  calculating  potentials 
(see  Table  2)  that  the  maximum  Is  and  that  the 

only  other  positive  6^^  Is  «  1.  From  the  discussion  of 

the  estimation  procedure  in  [^l^  ,  It  follows  that  emy  zero  non— 


basic  var.'able  whose  6^^^  Is  less  than  —  7 


4o  y 


must  stay  at  zero  value  In  any  optimal  tour,  while  any  positive 
non-baslc  variable  whose  Is  less  than  -  7  must 

stay  at  value  1  In  any  optimal  tour. 

In  Table  2  we  have  tabulated  all  from  the  table 

we  see  that.  In  addition  to  the  basic  set,  the  only  links  which, 
might  be  used  to  better  the  tour  of  Figure  5  are  those  corres¬ 
ponding  to 


(5) 


'04 


0,  6 


27 


-  1. 


1. 


46 


&4g  =  -  2, 


649  “  "  ^56  "  - 


o9 


Moreover,  the 

are 


corresponding  to  positive  non— J  asic  varla; les 


(6) 


-  -  2, 


25, 


3, 


2^., 


•ad  hence  it  follows  that  links  1,2  and  6,8  must  be  In  any 

optimal  tour. 

In  essence,  the  search  for  a  bette’"  tour  has  been  reduced 
to  the  following  problem.  Add  the  links  corresponding  to  th.e 
Of  (5)  to  the  network  shown  In  Figure  f  to  obtain  Figure 
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Any  better  tour  must  use  only  links  of  Figure  6.  To  compAre 
the  length  of  any  tour  of  this  network  with  our  present  tour, 
use  the  0^^:  a  6^^  >  0  of  (5)  represents  the  decrease  In 
tour  length  by  that  amount  If  link  1,J  Is  used;  a  <  0 

of  (3)  represents  the  Increase  In  tour  length  (by  the  amount 
~  used;  on  the  other  hand,  a  6^^  <0  of  (6) 

represents  the  Increase  In  tour  length  (by  ~  5^j)  If  1,J 
Is  not  used. 

It  is  now  a  simple  matter  to  deduce  that  the  tour 
(l ,2,3,4,5,0,9«3,6,7)  Is  optimal.  Ve  proceed  to  give  the 
argument: 

(a)  Links  6,8  and  1,2  must  be  In  (as  asserted  before), 

sine,  8gg  «  _  24  <  -  (6jg  8^g)  -  -  7. 

(b)  Link  1,7  must  be  In,  alnee  there  are  only  two  llnke 
at  city  1.  Hence  also  2,3  Is  in,  since  otherwise  we  would  have 
a  subloop  (1,2,7).  Thus  3*7  Is  out,  since  otherwise  the  sub^ 
loop  (1,2, 3, 7)  would  result. 

(c)  Next  look  at  cities  7  and  3*  There  are  only  two 
more  links  from  7,  namely  6,7  and  7,8,  one  of  which  must 

be  In.  Thus  link  3,6  is  out,  since  6,7  and  ^,6  in  results 
In  a  subloop  (l,2,3»6,7),  whereas  7,6  and  3*6  in  yields 
the  subloop  (1*2, 3*6, 8, 7) •  It  follows  that  link  3*^  must  be  in. 

(d)  Similarly  link  4,6  Is  out,  as  otherwise  we  would  have 
either  the  subloop  (l ,2, 3*4, 6, 7)  or  (l, 2, 3, 4, 6, 8, 7) . 

(e)  There  Is  no  better  tour  than  (l*2,3*4,5*0,9*8,6,7) , 
since  to  better  It,  we  must  use  at  least  one  of  the  links  3*6 

or  4,6,  both  of  which  have  now  been  eliminated  from  consideration. 
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One  can  go  on  to  show  that  this  tour  Is  uniquely  optimal, 
and  that  a  next  best  tour  is  (l>7,8,6,5»9»0,4,3,2) ,  of  length 
3  units  greater  than  the  optimal  tour  (since,  from  the  6»c, 
the  only  loss  Incurred  is  in  not  using  link  4,5  for  which 
•  —  5),  The  fact  that  this  tour  is  second  best  can  not  be 
deduced  merely  from  Figure  6  and  its  corresponding  6*8,  how¬ 
ever,  since,  for  example,  the  tour  (l,7,8,6,4,5,9,0,3#2)  is 
also  3  units  longer  than  the  optimal  one,  but  uses  link  0,3, 
which  is  not  in  Figure  6  (6^^  ■  —  9).  The  Jxicrease  in  length 

from  optimal  for  this  latter  tour  is  given  by  -  6q3  +  - 

1  *  9  -  6  •  3. 


% 

* 


I 


•C 

I 

iT 


f 


•J 

< 

•  \ 

•'1 


■4^. 

■H.''*  'J..  . 

^  ~.  W 

N/'* 

-» 

a-l4l56  ‘ 

.  ,y* 

h'  /"  -J 

*  < 

V2  3- 

■v«  “ 

V 

•> 

♦  ■ 

' 

-11- 

(2) 

;  ■> 

•<  • 

^  & 
••  ^ 

Sm 

0/ 

• 

(3) 

<•  ■■»  .(> 

^  .-v- 

ft 'In' 

-20 

0 

(4) 

Eijr  ^  ^ 

'  ■  ,•*  ,  “** 

«. 

--i 

PC-^^ 

-53^- 

-14  -3 

(5) 

*?♦ 

^  4 

•  f  JI¬ 

N'  *• 

-33. 

►  r 

-23 

Q  3  0  ‘  ■ 

(6) 

Table  2 


P-1281 

2-li|-58 

-12- 


Practicality  of  the  Method 

We  hope  that  our  primary  Intent,  to  shed  more  llcht  on  hov/ 
one  can  use  the  simplex  multipliers  In  a  combinatorial  analysis 
of  undomlnatcd  tours  at  some  stage  of  the  linear  programming 
approach,  has  been  fulfilled  by  our  discussion  of  the  example. 

It  is  our  feeling,  based  on  our  experience  In  solving  some 
thirty  or  more  problems  of  various  sizes,  that  the  suggested 
method  affords  a  practical  means  of  computing  optimal  tours  for 
problems  that  are  not  too  huge.  Certainly,  we  do  not  claim  to 
have  proved  that  the  imposition  of  simple  conditions  like  (l) 
and  (2)  will,  in  every  problem,  make  the  subsequent  combinatorial 
analysis  significantly  easier  than  a  direct  examination  of  all 
tours,  ^ut  then,  of  course,  no  one  has  yet  proved  that  the 
simplex  method,  for  example,  cuts  dovm  the  Job  of  computing  linear 
programs  significantly — compared  to  the  crude  method  of  examining 
all  basic  solutions,  say.  Nonetheless,  people  do  use  the  simplex 
method  because  of  successful  experience  with  many  hundreds  of 
nractlcal  problems. 
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